Systems and Methods for Controlling Camera Perspectives, Movements, and Displays of Video Game Gameplay

ABSTRACT

In a multiplayer video game, virtual cameras are controlled by continually assessing and ranking storylines relating to the interactions of various players during a game session. A ranking for each storyline may be based on various factors such as, but not limited to, what the players can see, the distance between certain players, nearby game items or in-game. Subsequently, at least one virtual camera is navigated to provide a view of the highest-ranking storyline, subject to certain limitations on how the camera can move, transition, or otherwise display the interactions between players. In embodiments, a set of rules including rules of cinematography, are used to provide additional control of the movement of the virtual camera. In embodiments, movements of a human camera-person are used on a mocap system to control the movement of the virtual camera.

CROSS-REFERENCE

The present application relies on, for priority, U.S. Patent ProvisionalApplication No. 62/952,637, titled “Systems and Methods for ControllingCamera Perspectives, Movements, and Displays of Video Game Gameplay” andfiled on Dec. 23, 2019.

The present application relates to U.S. patent application Ser. No.16/284,234, entitled “Systems and Methods for Controlling CameraPerspectives, Movements, and Displays of Video Game Gameplay”, and filedon Feb. 25, 2019, which relies on U.S. Provisional Patent ApplicationNo. 62/783,147, entitled “Systems and Methods for Controlling CameraPerspectives, Movements, and Displays of Video Game Gameplay”, filed onDec. 20, 2018, for priority.

The above-mentioned applications are herein incorporated by reference intheir entirety.

FIELD

The present application generally relates to the broadcasting of onlinegaming events. More particularly, the present application relates tocontrolling the movement and coverage of a camera to provide livebroadcast content.

BACKGROUND

Multiplayer online gaming has seen explosive proliferation across theglobe among a wide range of age groups. Similar to popular competitivesports, such as soccer, football, card games and basketball, multiplayeronline games also have a large fan following who relish watchingcompetitive online games and highly skilled players in action.

Consequently, the continued evolution and growth of online gaming,together with an ever-increasing fan base, have led to the rise inpopularity of video games as an in-person spectator sport or a virtualspectator sport. As with other sports, such fans enjoy being spectatorsof highly competitive games or games that popular players or influencersare participating in, either online or live, as is the case withorganized tournaments. In a multiplayer online game, spectators maywatch one or more players or teams of players involved in combat orotherwise participating in game play. Multiplayer online games mayinvolve a large number of players in a game session. For example, gamesmay support hundreds or thousands of active players including but notlimited to simple two-dimensional shooting games, multiplayer onlinebattle arena games, and massive multiplayer online role-playing games.

Existing video games enable spectators to view interesting moments ofgame play across a plurality of game events which develop as a result ofa large number of player interactions or actions. However,conventionally, only one or more virtual cameras are configured in avideo game to capture game play action. A virtual camera is an in-gameobject that, when executed in a video game, generates a visual,displayable viewpoint of the game that is a function of a) theprogrammed field of view of the virtual camera and b) the location ofthe in-game object, as defined by a three dimensional coordinate in avirtual game map. Those cameras are limited, however, in how theyfollow, track, and display game play action, often missing the mostinteresting interactions between players and failing to present a smoothtransition between different camera angles. Most of the currentimplementations of virtual cameras involve cameras positioned atspecific points, relative to specific virtual spaces or relative to thevirtual characters. Such cameras are limited in their movement,perspective, and field of view. The cameras only follow one or moreplayers, even if they are moving, and they do not follow the scenes thatmay be of most interest to an audience, similar to how the real-lifecamera-persons move and position their cameras according to interestingevents taking place during a live-action sport, such as football that isplayed in a stadium.

Accordingly, there is a need for video game systems and methods thatmore effectively control camera perspectives, and manage cameratransitions and displays, to ensure spectators have access to gameevents that are likely to be of high interest and/or entertainment valueto the spectators. There is also a need for systems and methods forcapturing and broadcasting interesting gameplay events in a realistic,real-world manner without detracting from the viewing experience of thespectators.

SUMMARY

The following embodiments and aspects thereof are described andillustrated in conjunction with systems, tools and methods, which aremeant to be exemplary and illustrative, and not limiting in scope. Thepresent application discloses numerous embodiments.

In some embodiments, the present specification discloses acomputer-implemented method of controlling at least one of a navigation,positioning or orientation of a virtual camera configured to capture aplurality of storylines in a multiplayer video game for broadcasting toat least one computing device, said method comprising: analyzing, in atleast one server remote from the at least one computing device, data toidentify the plurality of storylines; defining, in the at least oneserver, at least one criterion for controlling the at least one of thenavigation, positioning or orientation of the virtual camera;programmatically moving, in the at least one server, the virtual camerato capture one of the plurality of storylines based on the at least onecriterion; and broadcasting, from the at least one server to the atleast one computing device, the one of the plurality of storylinesdetermined based on the at least one criterion.

Optionally, the programmatically moving the virtual camera is based onone or more cinematography rules.

Optionally, the at least one criterion comprises at least one of astoryline ranking data, gameplay data, player data, or match data andwherein each of the storyline ranking data, the gameplay data, theplayer data, and the match data is determined from the multiplayer videogame.

Optionally, controlling the at least one of the navigation, positioningor orientation of the virtual camera uses the at least one criterion todetermine the storyline ranking data.

Optionally, the at least one criterion comprises combining a base rankfrom a base criteria and a weighting factor.

Optionally, the base criteria comprises at least one of a distancebetween two players in the multiplayer video game, locations of interestin a game map of the multiplayer video game, or virtual items ofinterest to spectators of the multiplayer video game.

Optionally, the weighting factor is based on at least one of arelationship between two players, a relative orientation of the twoplayers, or a field of view of the two players.

Optionally, controlling the at least one of the navigation, positioningor orientation of the virtual camera is based on storyline ranking datathat is generated in real time during the multiplayer video game.

Optionally, controlling the at least one of the navigation, positioningor orientation of the virtual camera is based on storyline ranking datathat is stored from previously played sessions of the multiplayer videogame.

Optionally, analyzing data to identify the plurality of storylinescomprises identifying at least one event in the multiplayer video gamethat is of interest to at least one spectator of the multiplayer videogame.

Optionally, programmatically moving the virtual camera is based on atleast one of data specific to players of the multiplayer video game,data applicable to the multiplayer video game, storyline data, storylineranking data, scenes of interest conveyed by one or more spectators ofthe multiplayer video game, input from a motion capture movementreference system, camera navigation rules, or cinematography rules.

Optionally, the camera navigation rules comprise at least one of a speedof movement of the virtual camera, an acceleration of movement of thevirtual camera, an angular speed of rotation of the virtual camera, oran angular acceleration of rotation of the virtual camera.

Optionally, programmatically moving the virtual camera based on inputfrom the motion capture movement reference system comprises: monitoringmovement of a human camera person within the motion capture movementreference system, wherein a virtual equivalent of the human cameraperson is positioned inside the multiplayer video game environment; andprogrammatically moving the virtual camera to capture one of theplurality of storylines based on the movement of the human cameraperson.

Optionally, programmatically moving the virtual camera comprisesenabling the human camera person to control at least one operation ofthe virtual camera and wherein the at least one operation comprises atleast one of moving the camera, panning-in or out, or modifying thecamera view.

In some embodiments, the present specification discloses a system forcontrolling at least one of a navigation, positioning or orientation ofa virtual camera configured to capture a plurality of storylines in amultiplayer video game executing in a plurality of gaming devices andconfigured to broadcast the multiplayer video game to a plurality ofspectator devices, said system comprising: at least one serverconfigured to host a game session of the multiplayer video game and tobroadcast the hosted game session to each of the plurality of spectatordevices through a network; a plurality of gaming modules stored on theplurality of gaming devices remote from the at least one server andconfigured to enable a plurality of human players to play in the gamesession of the multiplayer video game; a plurality of spectator modulesstored on the plurality of spectator devices remote from the at leastone server and configured to enable a plurality of human spectators toview the broadcast of the game session, wherein at least a portion ofthe plurality of spectator modules are executing on at least a portionof the plurality of gaming devices and wherein at least a portion of theplurality of gaming modules are executing on at least a portion of theplurality of spectator devices; at least one processor, in the at leastone server, wherein the at least one processor is configured to executea plurality of programmatic instructions to: define a function toidentify the plurality of storylines; define at least one criterion forcontrolling the at least one of the navigation, positioning ororientation of the virtual camera; programmatically moving the virtualcamera to capture one of the plurality of storylines based on the atleast one criterion and at least one cinematography rule; andbroadcasting the captured one of the plurality of storylines to at leasta portion of the plurality of gaming modules and/or at least a portionof the spectator modules.

Optionally, the at least one criterion comprises at least one of astoryline ranking data, gameplay data, player data, or match data andwherein each of the storyline ranking data, the gameplay data, theplayer data, and the match data is determined from the multiplayer videogame.

Optionally, controlling the at least one of the navigation, positioningor orientation of the virtual camera uses the at least one criterion todetermine the storyline ranking data.

Optionally, the at least one criterion comprises combining a base rankfrom a base criteria and a weighting factor.

Optionally, the base criteria comprises at least one of a distancebetween two players in the multiplayer video game, locations of interestin a game map of the multiplayer video game, or virtual items ofinterest to spectators of the multiplayer video game.

Optionally, the weighting factor is based on at least one of arelationship between two players, a relative orientation of the twoplayers, or a field of view of the two players.

Optionally, the at least one processor is configured to execute aplurality of programmatic instructions to control the at least one ofthe navigation, positioning or orientation of the virtual camera basedon storyline ranking data that is generated in real time during themultiplayer video game.

Optionally, the at least one processor is configured to execute aplurality of programmatic instructions to control the at least one ofthe navigation, positioning or orientation of the virtual camera basedon storyline ranking data that is stored from previously played sessionsof the multiplayer video game.

Optionally, the at least one processor is configured to execute aplurality of programmatic instructions to identify at least one event inthe multiplayer video game that is of interest to at least one spectatorof the multiplayer video game.

Optionally, the at least one processor is configured to execute aplurality of programmatic instructions to programmatically move thevirtual camera based on at least one of data specific to players of themultiplayer video game, data applicable to the multiplayer video game,storyline data, storyline ranking data, scenes of interest conveyed byone or more spectators of the multiplayer video game, input from amotion capture movement reference system, or camera navigation rules.

Optionally, the camera navigation rules comprise at least one of a speedof movement of the virtual camera, an acceleration of movement of thevirtual camera, an angular speed of rotation of the virtual camera, oran angular acceleration of rotation of the virtual camera.

Optionally, the at least one processor is configured to execute aplurality of programmatic instructions to programmatically move thevirtual camera based on input from the motion capture movement referencesystem by: monitoring movement of a human camera person within themotion capture movement reference system, wherein a virtual equivalentof the human camera person is positioned inside the multiplayer videogame environment; and programmatically moving the virtual camera tocapture one of the plurality of storylines based on the movement of thehuman camera person.

Optionally, the at least one processor is configured to execute aplurality of programmatic instructions to programmatically move thevirtual camera by enabling the human camera person to control at leastone operation of the virtual camera and wherein the at least oneoperation comprises at least one of moving the camera, panning-in orout, or modifying the camera view.

In some embodiments, the present specification discloses acomputer-implemented method of controlling at least one of a navigation,positioning or orientation of a virtual camera configured to capture aplurality of storylines in a multiplayer video game and for broadcastingthe multiplayer video game to at least one computing device, said methodcomprising: monitoring movement of a human camera person within a motioncapture movement reference system, wherein a virtual equivalent of thehuman camera person is positioned inside a virtual environment of themultiplayer video game environment and wherein the human camera personwears at least one illuminating marker; programmatically moving thevirtual camera to capture one of the plurality of storylines, based datafrom the motion capture movement reference system, wherein said data isbased on a movement of the human camera person; and broadcasting to atleast one computing device one of the plurality of storylines capturedby the human camera person.

Optionally, the monitoring comprises recording movement of the at leastone illuminating marker worn by the human camera person.

Optionally, programmatically moving the virtual camera comprisesenabling the human camera person to control at least one operation ofthe virtual camera, wherein the at least one operation comprises atleast one of moving the virtual camera, panning-in or out the virtualcamera, and modifying a view of the virtual camera.

Optionally, the method further comprises receiving data associated withthe human camera person controlling the at least one operation and,based on the received data, overriding data received from monitoringmovement of the human camera person within the motion capture movementreference system.

Optionally, the method further comprises displaying the multiplayervideo game to the human camera person while the human camera person isin the motion capture reference system.

In some embodiments, the present specification discloses acomputer-implemented method of controlling at least one of a navigation,positioning or orientation of a virtual camera configured to capture aplurality of storylines in a multiplayer video game for broadcasting toat least one computing device, said method comprising: analyzing, in atleast one server remote from the at least one computing device, data toidentify the plurality of storylines; defining, in the at least oneserver, at least one criterion for controlling the at least one of thenavigation, positioning or orientation of the virtual camera;programmatically moving, in the at least one server and subject to oneor more rules of cinematography, the virtual camera to capture one ofthe plurality of storylines based on the at least one criterion; andbroadcasting, from the at least one server to the at least one computingdevice, the one of the plurality of storylines determined based on theat least one criterion.

Optionally, the at least one criterion comprises at least one of astoryline ranking data, gameplay data, player data, and match data,wherein each data is determined from the multiplayer video game.

Optionally, the controlling based on at least one of a storyline rankingdata comprises using a first at least one criteria to determine thestoryline ranking data.

Optionally, the first at least one criteria comprises combining a baserank from a base criteria, and a weighting factor. Optionally, the basecriteria comprises at least one of a distance between two players in themultiplayer video game, locations of interest on a game map of themultiplayer video game, and virtual items of interest to spectators ofthe multiplayer video game.

Optionally, the weighting factor is based on at least one of arelationship between two players, a relative orientation of the twoplayers, and a field of view of the two players.

Optionally, the controlling based on at least one of a storyline rankingdata comprises generating storyline ranking data in real time during themultiplayer video game.

Optionally, the controlling based on at least one of a storyline rankingdata comprises generating storyline ranking based on historic data fromthe multiplayer video game.

Optionally, the analyzing data to identify the plurality of storylinescomprises identifying at least one event in the multiplayer video gamethat is of interest to at least one spectator of the multiplayer videogame.

Optionally, the programmatically moving the virtual camera comprisesanalyzing at least one of data sets that are specific to players of themultiplayer video game, data sets that are applicable to the multiplayervideo game, a storyline data, a storyline ranking data, scenes ofinterest conveyed by one or more spectators of the multiplayer videogame, input from a motion capture movement reference system, rulesgoverning camera navigation, and rules governing cinematography.

Optionally, the rules governing camera navigation comprise at least oneof a speed of movement, acceleration of movement, an angular speed ofrotation and an angular acceleration of rotation of the virtual camera.

Optionally, the programmatically moving the virtual camera based onanalysis of input from the motion capture movement reference systemcomprises: monitoring movement of a human camera person within themotion capture movement reference system, wherein a virtual equivalentof the human camera person is positioned inside the multiplayer videogame environment; and programmatically moving the virtual camera tocapture one of the plurality of storylines, based on the movement of thehuman camera person.

Optionally, the programmatically moving the virtual camera comprisesenabling the human camera person to control at least one operation ofthe virtual camera, wherein the at least one operation comprises one ofmoving the camera, panning-in or out, and fixing the camera view.

In some embodiments, the present specification discloses a system forcontrolling at least one of a navigation, positioning or orientation ofa virtual camera configured to capture a plurality of storylines in amultiplayer video game executing on a plurality of gaming devices forbroadcasting to a plurality of spectator devices, said systemcomprising: at least one server for hosting a game session of themultiplayer video game and to broadcast said game session to each of aplurality of spectator devices through a network; a plurality of gamingmodules stored on the plurality of gaming devices remote from the atleast one server and configured to enable a plurality of human playersto play in the game session of the multiplayer video game; a pluralityof spectator modules stored on the plurality of spectator devices remotefrom the at least one server and configured to enable a plurality ofhuman spectators to view the broadcast of the game session, wherein atleast a portion of the plurality of spectator modules are executing onat least a portion of the plurality of gaming devices and wherein atleast a portion of the plurality of gaming modules are executing on atleast a portion of the plurality of spectator devices; a processor insaid at least one server, said processor executing a plurality ofexecutable programmatic instructions to: define a function to identifythe plurality of storylines; define at least one criterion forcontrolling the at least one of the navigation, positioning ororientation of the virtual camera; subject to one or more rules ofcinematography, programmatically moving the virtual camera to captureone of the plurality of storylines based on the at least one criterion;and broadcasting the one of the plurality of storylines determined basedon the at least one criterion.

In some embodiments, the present specification discloses acomputer-implemented method of controlling at least one of a navigation,positioning or orientation of a virtual camera configured to capture aplurality of storylines in a multiplayer video game for broadcasting toat least one computing device, using a motion capture movement referencesystem, wherein the motion capture movement reference system comprises ahuman camera person wearing multiple illuminating markers, and acomputing device configured to program the virtual camera based on inputfrom the motion capture movement reference system, said methodcomprising: monitoring movement of the human camera person within themotion capture movement reference system, wherein a virtual equivalentof the human camera person is positioned inside the multiplayer videogame environment; programmatically moving the virtual camera to captureone of the plurality of storylines, based on the movement of the humancamera person; and broadcasting, to the at least one computing device,the one of the plurality of storylines captured by the human cameraperson.

Optionally, the monitoring comprises recording movement of one or moredigital markers worn by the human camera person.

Optionally, the programmatically moving the virtual camera comprisesenabling the human camera person to control at least one operation ofthe virtual camera, wherein the at least one operation comprises one ofmoving the camera, panning-in or out, and fixing the camera view.

Optionally, the control operations performed on the camera by the humancamera person override one or more input provided from the monitoringmovement of the human camera person within the motion capture movementreference system.

Optionally, the human camera person observes the plurality of storylinesin a multiplayer video game on a display device.

In some embodiments, the present specification discloses a system forcontrolling at least one of a navigation, positioning or orientation ofa virtual camera configured to capture a plurality of storylines in amultiplayer video game executing on a plurality of gaming devices forbroadcasting to a plurality of spectator devices, said systemcomprising: at least one server for hosting a game session of themultiplayer video game and to broadcast said game session to each of aplurality of spectator devices through a network; a plurality of gamingmodules stored on the plurality of gaming devices remote from the atleast one server and configured to enable a plurality of human playersto play in the game session of the multiplayer video game; a pluralityof spectator modules stored on the plurality of spectator devices remotefrom the at least one server and configured to enable a plurality ofhuman spectators to view the broadcast of the game session, wherein atleast a portion of the plurality of spectator modules are executing onat least a portion of the plurality of gaming devices and wherein atleast a portion of the plurality of gaming modules are executing on atleast a portion of the plurality of spectator devices; a processor insaid at least one server, said processor executing a plurality ofexecutable programmatic instructions to: define a function to identifythe plurality of storylines; define at least one criterion forcontrolling the at least one of the navigation, positioning ororientation of the virtual camera; subject to one or more rules ofcinematography, programmatically moving the virtual camera to captureone of the plurality of storylines based on the at least one criterion;and, broadcasting the one of the plurality of storylines determinedbased on the at least one criterion, wherein the processor renders thevideo for broadcasting to the plurality of spectator devices.

In some embodiments, the present specification discloses acomputer-implemented method of controlling at least one of a navigation,positioning or orientation of a virtual camera configured to capture aplurality of storylines in a multiplayer video game for broadcasting toat least one computing device, said method comprising: analyzing, in atleast one server remote from the at least one computing device, data toidentify the plurality of storylines; defining, in the at least oneserver, at least one criterion for controlling the at least one of thenavigation, positioning or orientation of the virtual camera;programmatically moving, in the at least one server and subject to oneor more rules of cinematography, the virtual camera to capture one ofthe plurality of storylines based on the at least one criterion; andbroadcasting, from the at least one server to the at least one computingdevice, the one of the plurality of storylines determined based on theat least one criterion.

Optionally, the at least one criterion comprises at least one of astoryline ranking data, gameplay data, player data, and match data,wherein each data is determined from the multiplayer video game.

In some embodiments, the present specification comprises a system forcontrolling at least one of a navigation, positioning or orientation ofa virtual camera configured to capture a plurality of storylines in amultiplayer video game executing on a plurality of gaming devices forbroadcasting to a plurality of spectator devices, said systemcomprising: at least one server for hosting a game session of themultiplayer video game and to broadcast said game session to each of aplurality of spectator devices through a network; a plurality of gamingmodules stored on the plurality of gaming devices remote from the atleast one server and configured to enable a plurality of human playersto play in the game session of the multiplayer video game; a pluralityof spectator modules stored on the plurality of spectator devices remotefrom the at least one server and configured to enable a plurality ofhuman spectators to view the broadcast of the game session, wherein atleast a portion of the plurality of spectator modules are executing onat least a portion of the plurality of gaming devices and wherein atleast a portion of the plurality of gaming modules are executing on atleast a portion of the plurality of spectator devices; a processor insaid at least one server, said processor executing a plurality ofexecutable programmatic instructions to: define a function to identifythe plurality of storylines; define at least one criterion forcontrolling the at least one of the navigation, positioning ororientation of the virtual camera; subject to one or more rules ofcinematography, programmatically moving the virtual camera to captureone of the plurality of storylines based on the at least one criterion;and broadcasting the one of the plurality of storylines determined basedon the at least one criterion.

In some embodiments, the present specification discloses a computerreadable non-transitory medium comprising a plurality of executableprogrammatic instructions wherein, when said plurality of executableprogrammatic instructions are executed by a processor in at least oneserver, a process for controlling navigation, positioning andorientation of a virtual camera configured to capture a plurality ofstorylines in a multiplayer video game for broadcasting to at least onespectator device, said plurality of executable programmatic instructionscomprising: programmatic instructions, stored in said computer readablenon-transitory medium, for determining at least one criterioncontrolling the at least one of the navigation, positioning ororientation of the virtual camera; and programmatic instructionscomprising a plurality of rules of cinematography, stored in saidcomputer readable non-transitory medium, for moving the virtual camerato capture one of the plurality of storylines determined based on the atleast one criterion.

In some embodiments, the present specification discloses acomputer-implemented method of controlling at least one of a navigation,positioning or orientation of a virtual camera configured to capture aplurality of storylines in a multiplayer video game for broadcasting toat least one computing device, using a motion capture movement referencesystem, wherein the motion capture movement reference system comprises ahuman camera person wearing multiple illuminating markers, and acomputing device configured to program the virtual camera based on inputfrom the motion capture movement reference system, said methodcomprising: monitoring movement of the human camera person within themotion capture movement reference system, wherein a virtual equivalentof the human camera person is positioned inside the multiplayer videogame environment; programmatically moving the virtual camera to captureone of the plurality of storylines, based on the movement of the humancamera person; broadcasting, to the at least one computing device, theone of the plurality of storylines captured by the human camera person.

In some embodiments, the present specification discloses a system forcontrolling at least one of a navigation, positioning or orientation ofa virtual camera configured to capture a plurality of storylines in amultiplayer video game executing on a plurality of gaming devices forbroadcasting to a plurality of spectator devices, said systemcomprising: at least one server for hosting a game session of themultiplayer video game and to broadcast said game session to each of aplurality of spectator devices through a network; a plurality of gamingmodules stored on the plurality of gaming devices remote from the atleast one server and configured to enable a plurality of human playersto play in the game session of the multiplayer video game; a pluralityof spectator modules stored on the plurality of spectator devices remotefrom the at least one server and configured to enable a plurality ofhuman spectators to view the broadcast of the game session, wherein atleast a portion of the plurality of spectator modules are executing onat least a portion of the plurality of gaming devices and wherein atleast a portion of the plurality of gaming modules are executing on atleast a portion of the plurality of spectator devices; a processor insaid at least one server, said processor executing a plurality ofexecutable programmatic instructions to: define a function to identifythe plurality of storylines; define at least one criterion forcontrolling the at least one of the navigation, positioning ororientation of the virtual camera; subject to one or more rules ofcinematography, programmatically moving the virtual camera to captureone of the plurality of storylines based on the at least one criterion;and, broadcasting the one of the plurality of storylines determinedbased on the at least one criterion, wherein the processor renders thevideo for broadcasting to the plurality of spectator devices.

The aforementioned and other embodiments of the present specificationshall be described in greater depth in the drawings and detaileddescription provided below.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features and advantages of the present specificationwill be further appreciated, as they become better understood byreference to the following detailed description when considered inconnection with the accompanying drawings:

FIG. 1 is a block diagram of a multiplayer online gaming system orenvironment in which a plurality of spectating modalities may beenabled, implemented or executed, in accordance with some embodiments ofthe present specification;

FIG. 2 is a flow chart showing steps in computer-implemented method fortracking and ranking one or more storylines in a game match of amultiplayer online video game, in accordance with some embodiments ofthe present specification;

FIG. 3A is an exemplary block diagram illustrating the different typesof data that may be combined with specific rules of cinematography, tocontrol the position and movement of a virtual camera;

FIG. 3B is a flow chart showing steps of a computer-implemented methodof controlling navigation, position, and orientation of a virtual cameraconfigured to capture a plurality of scenes of interest in a multiplayervideo game for broadcasting to at least one spectator device, inaccordance with some embodiments of the present specification;

FIG. 3C is a flow chart showing steps of a computer-implemented methodof controlling navigation, position, and orientation of a virtual cameraconfigured to capture a plurality of storylines in a multiplayer videogame for broadcasting to at least one spectator device, in accordancewith some embodiments of the present specification;

FIG. 3D is a flow chart showing steps of another computer-implementedmethod of controlling navigation, position, and orientation of a virtualcamera configured to capture a plurality of scenes of interest in amultiplayer video game for broadcasting to at least one spectatordevice, in accordance with some embodiments of the presentspecification;

FIG. 3E is a flow chart showing steps of a computer-implemented methodof incorporating the mocap system to control the virtual camera, inaccordance with some embodiments of the present specification; and

FIG. 4 is a flow chart showing various steps of a computer-implementedmethod of enabling at least one spectator to view video data associatedwith one or more storylines in a game match of a multiplayer video game,in accordance with some embodiments of the present specification.

DETAILED DESCRIPTION

The present specification is directed towards multiple embodiments. Thefollowing disclosure is provided in order to enable a person havingordinary skill in the art to practice the invention. Language used inthis specification should not be interpreted as a general disavowal ofany one specific embodiment or used to limit the claims beyond themeaning of the terms used therein. The general principles defined hereinmay be applied to other embodiments and applications without departingfrom the spirit and scope of the invention. Also, the terminology andphraseology used is for the purpose of describing exemplary embodimentsand should not be considered limiting. Thus, the present invention is tobe accorded the widest scope encompassing numerous alternatives,modifications and equivalents consistent with the principles andfeatures disclosed. For purpose of clarity, details relating totechnical material that is known in the technical fields related to theinvention have not been described in detail so as not to unnecessarilyobscure the present invention.

The present specification is directed towards multiple embodiments. Forexample, the systems and methods described herein may be applied tomultiplayer video games in numerous genres, including first personshooter (FPS), fighting games, survival games, action-adventure games,role-playing games, simulation games, strategy games, sports, cardgames, and racing games. The following disclosure is provided in orderto enable a person having ordinary skill in the art to practice theinvention. Language used in this specification should not be interpretedas a general disavowal of any one specific embodiment or used to limitthe claims beyond the meaning of the terms used therein. The generalprinciples defined herein may be applied to other embodiments andapplications without departing from the spirit and scope of theinvention. Also, the terminology and phraseology used is for the purposeof describing exemplary embodiments and should not be consideredlimiting. Thus, the present invention is to be accorded the widest scopeencompassing numerous alternatives, modifications and equivalentsconsistent with the principles and features disclosed. For purpose ofclarity, details relating to technical material that is known in thetechnical fields related to the invention have not been described indetail so as not to unnecessarily obscure the present invention.

In the description and claims of the application, each of the words“comprise” “include” and “have”, and forms thereof, are not necessarilylimited to members in a list with which the words may be associated. Itshould be noted herein that any feature or component described inassociation with a specific embodiment may be used and implemented withany other embodiment unless clearly indicated otherwise.

As used herein, the indefinite articles “a” and “an” mean “at least one”or “one or more” unless the context clearly dictates otherwise.

In some embodiments, execution of a plurality of sequences ofprogrammatic instructions or code enables or causes the CPU of thecomputing device to perform various functions and processes. Inalternate embodiments, hard-wired circuitry may be used in place of, orin combination with, software instructions for implementation of theprocesses of systems and methods described in this application. Thus,the systems and methods described are not limited to any specificcombination of hardware and software. It should further be appreciatedthat each computing system, including servers and computing devices,have wireless and wired receivers and transmitters capable of sendingand transmitting data, at least one processor capable of processingprogrammatic instructions, memory capable of storing programmaticinstructions, and software comprised of a plurality of programmaticinstructions for performing the processes described herein.

In various embodiments, the system includes at least one processorcapable of processing programmatic instructions, has a memory capable ofstoring programmatic instructions, and employs software comprised of aplurality of programmatic instructions for performing the processesdescribed herein. In embodiments, a computer-readable non-transitorymedium comprises the plurality of executable programmatic instructions.In one embodiment, the at least one processor is a computing devicecapable of receiving, executing, and transmitting a plurality ofprogrammatic instructions stored on a volatile or non-volatile computerreadable medium.

In various embodiments, a computing device includes an input/outputcontroller, at least one communications interface and system memory. Thesystem memory includes at least one random access memory (RAM) and atleast one read-only memory (ROM). These elements are in communicationwith a central processing unit (CPU) to enable operation of thecomputing device. In various embodiments, the computing device may be aconventional standalone computer or alternatively, the functions of thecomputing device may be distributed across multiple computer systems andarchitectures.

The term “module”, “application” or “engine” used in this disclosure mayrefer to computer logic utilized to provide a desired functionality,service or operation by programming or controlling a general purposeprocessor. Stated differently, in some embodiments, a module,application or engine implements a plurality of instructions orprogrammatic code to cause a general purpose processor to perform one ormore functions. In various embodiments, a module, application or enginecan be implemented in hardware, firmware, software or any combinationthereof. The module, application or engine may be interchangeably usedwith unit, logic, logical block, component, or circuit, for example. Themodule, application or engine may be the minimum unit, or part thereof,which performs one or more particular functions.

The term “platform” or “target gaming platform” used in this disclosuremay refer to hardware and/or software specifications of a player'sclient device (which may be a PC or a gaming console, for example). Insome embodiments, “platform” may refer to at least GPU (GraphicsProcessing Unit) specification, CPU specification, display screenresolution, RAM and hard disk space available and a type of operatingsystem.

The term “offline” or “offline process” used in this disclosure refersto one or more programmatic instructions or code that may be implementedor executed while the game is not being played by any player (that is,while the one or more game servers are not rendering a game forplaying).

The term “runtime” or “runtime process” used in this disclosure refersto one or more programmatic instructions or code that may be implementedor executed during gameplay (that is, while the one or more game serversare rendering a game for playing).

The term ‘virtual camera’ or ‘camera’ refers to at least one viewingelement configured to capture or provide a view of game play in thevirtual world associated with a video game. It should be appreciatedthat akin to a physical camera, the at least one virtual camera may haveassociated position coordinates to uniquely identify its location withina gaming world. Also, in various embodiments, a virtual camera may becharacterized by a plurality of customizable parameters such as, but notlimited to, orientation, viewing angle, focal length, zoom factor, tiltand pan.

The term ‘storyline’ is defined as an aggregated set of data defining aplayer's visual and auditory in-game interactions, e.g. with one or moreother players. Storyline data may refer to all, or a portion, of theprogrammatic data defining the visual storyline, auditory storyline andassociated metadata pertaining or incidental thereto which, if processedand rendered, would visually and aurally display the storyline to one ormore human spectators. Storyline data may be indicative of one or morepreferred positions, angles, foci, fields of view, or perspectives ofone or more cameras.

The term ‘scenes of interest’ refer to the scenes, including storylines,which are of individual interest to viewers or spectators, including aperson, a group of people, e-sports streamers and broadcasters. Thescenes of interest may be derived from storyline data.

The term ‘player’ refers to any human or virtual actor within a game,where the human or virtual actor may engage in play actions, socialactions, administrative actions, or observation actions.

‘Motion capture (mocap)’ is the process of recording the movement ofreal objects, such as a human actor, in order to create source data thatis used to conform the movement onto a computer graphics animationcharacter or digital avatar of the object. A typical mocap system usesone or more digital cameras to record the movement of the actor whileilluminating a number of markers attached at a number of locations on asuit that the actor wears. A digital representation or rendering of theactor in motion is thereafter generated by analyzing the coordinates ofthe markers in the captured images and mapping them onto a correspondingcomputer graphics animation character. Mocap offers advantages overtraditional computer animation of a 3D model such as: enabling a previewof the spatial representation of the actor's movements in real-time ornear real-time, and allowing computer graphics animation characters todisplay more realistic and natural movement characteristics.

As used herein, the term ‘cameraman’ refers to a being, such as a human,who is the subject of a motion capture system, wears clothing havingmarkers attached at various locations to enable digital cameras torecord the being's movement, and is expected to carry a virtual cameradevice which allows the cameraman to control camera position andmovement in a virtual game environment, in accordance with theimplementations of the present application. The virtual camera devicecarried by the cameraman may include, and is not limited to, a standardgamepad and monitor, a gamepad and an Augmented Reality (AR) or VirtualReality (VR) headset, or a device that has motion sensors that enablesto the cameraman to move and tilt the device to change views of thevirtual camera in the game.

It should be appreciated that each of the claim limitations, when viewedas an ordered combination, amount to significantly more than just anabstract idea or concept. The methods and systems of the presentinvention represent technical improvements to a form of computertechnology, video games, by providing a specialized computer systemconfigured to host a plurality of concurrently executing video gamestreaming applications (for example, anywhere from at least 10 videogame streaming applications to at least 100,000,000 video game streamingapplications or any increment therein), host a plurality of clientdevices associated with remotely located players (for example, anywherefrom at least 10 client devices associated with players to at least100,000,000 client devices associated with players, or any incrementtherein), and perform a series of programmatic steps designed to, amongother features, control camera perspectives, and manage cameratransitions and displays, to ensure spectators have access to gameevents that are likely to be of high interest and/or entertainment valueto the spectators. In addition, the presently disclosed embodiments aredirected to systems and methods for capturing and broadcastinginteresting gameplay events in a realistic, real-world manner withoutdetracting from the viewing experience of the spectators.

FIG. 1 illustrates an embodiment of a multiplayer online gaming systemor environment 100 in which a plurality of spectating modalities may beenabled, implemented or executed, in accordance with some embodiments ofthe present specification. The system 100, in some embodiments,comprises a client-server architecture, where one or more game servers105 are in communication with one or more player devices 110 and one ormore spectator devices 145 over a network 115. Players may access thesystem 100 via the one or more player devices 110 while one or morespectators or viewers may access the system 100 using the one or morespectator devices 145. The player devices 110 and the spectator devices145 comprise computing devices such as, but not limited to, personal ordesktop computers, laptops, Netbooks, handheld devices such assmartphones, tablets, and PDAs, gaming consoles and/or any othercomputing platform known to persons of ordinary skill in the art.Although four player devices 110 and three spectator devices 145 areillustrated in FIG. 1, any number of player and spectator devices 110,145 can be in communication with the one or more game servers 105 overthe network 115. Also, in some embodiments, the spectator devices 145include facilities similar to Esports Arena or locations/theatersdeploying large display screens to enable a number of spectators tosimultaneously view a game match.

The one or more game servers 105 can be any computing device having oneor more processors and one or more computer-readable storage media suchas RAM, hard disk or any other optical or magnetic media. The one ormore game servers 105 include a plurality of modules operating toprovide or implement a plurality of functional, operational orservice-oriented methods of the present specification. In someembodiments, the one or more game servers 105 include or are incommunication with at least one database system 150. The database system150 stores a plurality of game data associated with at least one gamethat is served or provided to the player devices 110 for game-play andto the spectator devices 145 for viewing and engagement over the network115. In embodiments, the database system 150 also stores a plurality ofdata such as, but not limited to, storyline data, storyline rankingdata, storyline ranking rules or logic, and/or camera movement orintelligence rules or logic. The database system 150 further includeshistorical gameplay data, data about each player including theperformance of the player, and real time match data includinginformation about the locations of action in game. In some embodiments,the one or more game servers 105 may be implemented by a cloud ofcomputing platforms operating together as game servers 105.

In embodiments, the one or more game servers 105 provide or implement aplurality of server-side modules such as, but not limited to, a mastergame engine or module 120, a storyline ranking engine or module 130 anda camera intelligence engine or module 135. In embodiments, the one ormore player devices 110 and spectator devices 145 respectively provideor implement client-side modules such as, but not limited to, a playergame module 120′ and a spectator engagement module 140. In embodiments,the player game module 120′ is same as or similar to the counterpartserver-side module 120. In some embodiments, the client-side modules120′ and 140 are configured to connect and communicate with theplurality of modules on the server 105 via the network 115.

The one or more game servers 105 are preferably configured toconcurrently communicate with at least 20 spectator devices, and morepreferably 20 to 1,000,000 spectator devices or any increment therein,such that each of said at least 20 spectator devices are permitted toconcurrently receive a broadcast of the storylines selected and recordedby a virtual camera. In another embodiment, the one or more game serversare configured to concurrently host at least 5 storyline broadcasts persecond, preferably 50-150 storyline broadcasts per second, with theplurality of spectator devices.

Master Game Module 120

In embodiments, the master game module 120 is configured to execute aninstance of an online game to facilitate interaction of the players withthe game. In embodiments, the instance of the game executed may besynchronous, asynchronous, and/or semi-synchronous. The master gamemodule 120 controls aspects of the game for all players and receives andprocesses each player's input in the game. In other words, the mastergame module 120 hosts the online game for all players, receives gamedata from the player devices 110 and transmits updates to all playerdevices 110 based on the received game data so that the game, on each ofthe player devices 110, represents the most updated or current statuswith reference to interactions of all players with the game and/or withone another (depending upon the type or genre of game match beingplayed). Thus, the master game module 120 transmits game data over thenetwork 115 to the player devices 110 for use by the game module 120′ toprovide local versions and current status of the game to the players.

Player Game Module 120′

On the client side, each of the one or more player devices 110implements the game module 120′ that operates as a gaming application toprovide a player with an interface between the player and the game. Thegame module 120′ generates the interface to render a virtualenvironment, virtual space or virtual world associated with the game andenables the player to interact in the virtual environment to perform aplurality of game tasks and objectives. The game module 120′ accessesgame data received from the game server 110 to provide an accuraterepresentation of the game to the player. The game module 120′ capturesand processes player inputs and interactions within the virtualenvironment and provides updates to the game server 110 over the network115.

Storyline and Storyline Data

As previously described, the term “storyline” is defined as an in-game,virtual interaction between a first player and at least one other secondplayer or actor in a multiplayer video game. A storyline thereforeincludes outcomes, occurrences, episodes or events, which occur in agame match and that are of value, significance, appeal, curiosity orinterest to a spectator and, therefore, impact the viewership,engagement, learning and/or entertainment value of a video game.

As an example, in a multiplayer shooting or combat game a storyline maybe defined as interactions/combats between each player and every otherplayer in the match. In a two player versus two player first personshooter (FPS) game involving A, B, C and D players there may bepotentially six storylines (AB, AC, AD, BC, BD, and CD). Thus, a firstperson shooter (FPS) game session may include x number of playersthereby creating n number of storylines, with any combination orpermutation of players possible. In the example provided above, a threeplayer storyline may include ABC, ABD, ACD, or BCD.

More generally, a given multiplayer video game may have n(n−1)/2 numberof storylines where n represents the total number of players or actorswho may interact with each other in the game and where each storylinerepresents an interaction between two distinct players. Notwithstandingthe above, the number of storylines may be modified based on a pluralityof rules. For example, the system may eliminate, ignore, or otherwisefilter one or more of the storylines based on whether a player or actorfalls into a certain category or has a predefined characteristics, suchas having a rank that is below a threshold value, having a title, labelor designation that is not preferred, being on the same team as theother player with whom the storyline would be defined, having a score,point total, health level, number of kills, or amount of treasure thatis below a threshold level, or having weaponry types that are notpreferred. Accordingly, storylines may be filtered such that theremaining set of storylines only pertain to interactions between playerson opposing teams or only to key players (such as, in a football game,quarterback, running back, or wide receiver while ignoring linemen) orplayers ranked in the top 10.

Storyline Ranking Engine or Module 130

The storyline ranking module 130 implements or executes a plurality ofinstructions or programmatic code to track one or more storylines asthese are generated during a game match, acquire and store data(storyline data) associated with each of the storylines and rank each ofthe storylines in accordance with a plurality of pre-stored yetcustomizable storyline ranking logic, rules, guidelines, or imperatives.In various embodiments, the storyline data, storyline ranking data andthe plurality of storyline ranking rules are stored in the databasesystem 150.

For the purposes of illustrating the ranking functionalities andfeatures of the module 130 the present specification refers to shootergames genre and specifically a first-person shooter (FPS) game such as,for example, Call of Duty, in accordance with some embodiments. A firstperson shooter (FPS) game session is now considered, as an example,where Team Alpha (A) of first and second players is pitted in shootingcombat with Team Beta (B) of third and fourth players.

As the gameplay ensues between Team Alpha (A) and Team Beta (B), aplurality of events or interactions between members of Team A and Team Bunfold. In some embodiments, the plurality of storyline ranking logic,rules, guidelines or imperatives are applied such that they consider,establish or assign at least one base factor or criterion for rankingfollowed by at least one multiplier factor or criterion that has anaccentuating or diminishing effect (on the overall ranking) dependingupon the type or genre of the game.

In the first person shooter (FPS) game session, in some embodiments, adistance between two players in the game match is considered as the basecriterion for ranking the storylines. In other words, the base criterionis a distance determined for each player with respect to every otherplayer participating in the first person shooter (FPS) game session. Forexample, in a game map, the maximum distance between two players will bea known or fixed number, for example, 8000 units at the two farthestpoints in the game map. Therefore, at any given moment, any two playerswill be between 1 and 8000 units apart from each other. However, fromthe spectators' vantage points, valuable storylines are those where thetwo players are closer to each other because there is a greater chanceof meaningful interaction.

Therefore, in some embodiments, the module 130 establishes proximity oftwo players as a base factor or criterion and consequently determines abase rank by inverting (that is, taking the reciprocal of) the distancebetween the two players in the game match. Thus, if the two players are8000 units apart from each other the base ranking assigned to theirstoryline is the lowest (1/8000) whereas if the two players are 1 unitapart from each other the base ranking assigned to their storyline isthe highest (1/1) in the game match. In some embodiments, the baseranking may be calculated as a percentage (1/8000=0.125%, 1/1=100%).Therefore, a storyline may be weighted using a factor that is a functionof the distance between the players defining the storyline, where thefunction provides for a larger factor, or weight, if the players arecloser to each other and a smaller factor, or weight, if the players arefurther away from each other.

In some embodiments, the module 130 further establishes at least onemultiplier or weighting factor or criterion and assigns an accentuatingor diminishing coefficient or value thereto depending upon the value (aninterest or value quotient) of the multiplier or weighting factor fromthe vantage point of the spectators. In the first person shooter (FPS)game, in some embodiments, following exemplary multiplier factors areestablished by the module 130 and assigned a corresponding coefficient:

-   -   A first multiplier or weighting factor is representative of a        relationship between the two players. Thus, a coefficient of,        for example, “5” may be assigned if the two players are from        opposing teams—that is, the two players are enemies. However, if        the two players are from the same team then a coefficient of,        for example “1” or any increment therein in a range 0 to 1 may        be assigned. In other words, the module 130 puts more emphasis        and value on storylines between opponents or foes. Therefore, a        storyline may be weighted using a factor that is a function of        the relationship between the players defining the storyline,        where the function provides for a larger factor, or weight, if        the players are in opposition to each other and a smaller        factor, or weight, if the players are in cooperation with each        other. Note that this, and all subsequent, weighting approaches        may be used in place of eliminating or filtering out such        storylines altogether, as described above.    -   A second multiplier or weighting factor is representative of an        orientation of the two players with respect to each other. Thus,        a coefficient of, for example, “2” may be assigned if each of        two players (from opposing teams, each having two players) are        facing each other; a coefficient of, for example, “1.5” may be        assigned if only one of the two players (from opposing teams) is        facing the other. However, if neither of the two players (from        opposing teams) is facing the other then a coefficient of, for        example “1” or any increment therein in a range of 0 to 1 may        assigned. Therefore, a storyline may be weighted using a factor        that is a function of the orientation between the players        defining the storyline, where the function provides for a larger        factor, or weight, if the players are fully or partially        oriented toward each other and a smaller factor, or weight, if        the players are oriented away from each other. Accordingly, the        module 130 places more emphasis or weighted value on storylines        between opponents/foes/enemies where at least one player is        facing the other thereby indicative of a possible combat event.        In some embodiments, the second multiplier or weighting factor        is also indicative of whether the virtual camera can establish a        position and/or orientation where both players are visible.    -   A third multiplier or weighting factor is representative of what        the two players can “see” or have in their field of view (FOV).        Thus, a coefficient of, for example “2” may be assigned if the        player (that the virtual camera is closest to) can actually see        the other player without any obstructions in the view (that is,        an unobstructed view).

Thus, in some embodiments, a base ranking determined from a basecriterion, such as the proximity of two players, when multiplied by oneor more coefficients determined from one or more multiplier factorsprovides an overall ranking of a storyline between the two players, asfollows:

R=k1×(br)+k2×(br)+ . . . +kn×(br), where R is the overall ranking of astoryline between two players, k1 to kn are coefficients correspondingto ‘n’ number of multiplier factors and br is the base rankingdetermined established on a base factor/criteria. In variousembodiments, the value of the coefficients may be real numbers rangingbetween 0 and 1 (0≤coefficient≤1) corresponding to multiplier factorsthat have diminishing effects (that is, are low in terms of value forspectators) and may be real numbers greater than 1 (1≤coefficient)corresponding to multiplier factors that have accentuating oremphasizing effects (that is, are high in terms of value forspectators).

In the first person shooter (FPS) game example of Team Alpha and TeamBeta, in accordance with the base and multiplier criteria, module 130 isprogrammed to value conflict and combat. Also, it should be appreciatedthat the base and multiplier factors or criteria are customizable by anadministrator. That is, the plurality of rules or logic implemented bythe module 130, to determine the storyline rankings, may be expanded orrelaxed/briefed depending on factors such as, but not limited to, gamemode, type, genre, and/or level. For example, in some embodiments, themodule 130 generates the overall storyline ranking not only on the basisof player relationships (the first multiplier factor) but also othercriteria such as, but not limited to a) locations of interest on a gamemap (for example, storylines taking place in the center of the game map,a particular building, and/or on a bridge may be ranked higher or lowerdepending upon the perceived value for the spectators), and b) certainvirtual items or combat gear of interest to spectators (such as,vehicles, combat weapons, positions of advantage in terms of firststrike).

In some embodiments, the module 130 implements a plurality ofinstructions or programmatic code to acquire storyline data and generatestoryline rankings (also referred to as ‘storyline ranking data’) inreal-time or near real-time as the storylines develop between theplayers during the game map. In such embodiments, the game match isavailable for spectating in real-time during the game match.Accordingly, a first plurality of rules (such as those described above)are used by the module 130 to establish the base and multiplier factorsin order to determine the overall ranking of the storylines in realtime.

However, in some embodiments, the module 130 implements a plurality ofinstructions or programmatic code to acquire storyline data and generatestoryline rankings when the game match is broadcasted for spectatingwith time delay or after the match is complete. Accordingly, a secondplurality of rules are used by the module 130 to establish the base andmultiplier factors in order to determine the overall ranking of thestorylines. For example, if the match is already complete the secondplurality of rules enable the module 130 to assess and rank storylineswith the benefit of already knowing their outcome. For example, aparticular interaction between two players of opposing teams that seemedmundane in the beginning may lead to a very exciting or game-definingbattle towards the end of the match. With the known outcome, the secondplurality of rules enable the module 130 to assign an overriding highranking to this match. Such second plurality of rules includes assigninga greater weighting value to the player or players who achieved thehighest score, number of kills, wins, or rank, thereby increasing theranking of storylines involving those players, assigning a greaterweighting value to the player or players who are positioned in aparticular location which experienced interesting gameplay, therebyincreasing the ranking of storylines involving that location and/orassigning a greater weighting value to the player or players whoparticipated in the most interesting gameplay action.

In embodiments, the module 130 continuously or pseudo-continuouslyevaluates all relevant storylines for rankings depending upon at leastthe complexity of the game. In some embodiments, the module evaluates ordetermines the rankings of all relevant storylines at a frequency orrefresh-rate of ‘t’ times per second. In some embodiments, the value of‘t’ varies from 1 to 60 times per second. In some embodiments, a refreshoccurs on a frame-by-frame basis. In another embodiment, a refreshoccurs every second. In an embodiment, the frequency of storylineevaluation for ranking generation is 4 times per second. It should beappreciated that in embodiments, the refresh-rate is also a function ofthe available processing power at the spectator devices 145. Forexample, a gaming console may be able to render storylines, commensuratewith updated rankings, more frequently than a mobile device.Accordingly, the refresh-rate may be programmatically modified basedupon the processing power of the client device where a lowerrefresh-rate is implemented with a lower processing power and a higherrefresh-rate is implemented with a higher processing power.

Persons of ordinary skill in the art should appreciate that the basefactor and multiplier factors may differ across game genres, modesand/or levels. For example, in multiplayer platform games (where aplurality of players controls their corresponding characters or avatarsto jump between suspended platforms and avoid obstacles) the base factormay be an advance level that has been reached in the game by a playerand/or a threshold number of points amassed by a player. Again, inmultiplayer adventure games (where a plurality of players assume therole of protagonists in an interactive story driven by exploration andpuzzle-solving instead of physical challenge) the base factor may be anadvance level of difficulty that has been reached in the game by aplayer. Yet again, in strategy games such as multiplayer online battlearenas or MOBAs (that are a hybrid of action games, real-time strategyand role-playing video games where the objective is for the player'steam to destroy the opposing side's main structure with the help ofperiodically spawned computer-controlled units that march towards theenemy's main structure) the base factor may be a team of playersoccupying or destroying key sub-structure(s) of the opposing team's mainstructure, hideout or fort.

It should be appreciated that the module 130 communicates the determinedoverall storyline rankings to the camera intelligence module 135 andalso stores the rankings in the database system 150.

FIG. 2 is a computer-implemented method 200 of tracking and ranking oneor more storylines in a game match of a multiplayer online video game,in accordance with some embodiments of the present specification. Inembodiments, the method 200 is implemented by the storyline rankingmodule 130. Referring now to FIGS. 1 and 2, at step 205, a premise orprinciple, collectively referred to as a function, is defined orestablished to identify the one or more storylines, depending upon atleast the genre, type or level of the multiplayer online video game. Forexample, in some embodiments, for a first person shooter (FPS) genre,the basic premise pertains to combative interactions amongst a pluralityof players participating in the multiplayer video game.

At step 210, at least one base criterion is defined or established toenable ranking each of the one or more storylines. For example, in afirst person shooter (FPS) game session, the at least one base criterionis a distance of each player with respect to every other playerparticipating in said multiplayer video game. Accordingly, positioncoordinates (within the game map) of each player are acquired anddistances of each player with respect to every other player arecalculated based on the positional coordinates. At step 215, dependingupon the at least one base criterion a base rank is determined for eachof the one or more storylines. In various embodiments, the base rank isa function of the at least one base criterion. For example, if adistance (base criterion) between any two players in the first personshooter (FPS) game session is ‘D’ units, then the corresponding baserank for the storyline associated with the two players is determined tobe a reciprocal of the distance—that is, the base rank is 1/D points.

At step 220, one or more weighting or multiplier factors are defined orestablished. In embodiments, the one or more weighting factors havepredetermined values. In some embodiments, the one or more weightingfactors comprise a first factor representative of a relationship betweeneach player with respect to every other player in the game match, asecond factor representative of an orientation of each player withrespect to every other player and a third factor representative ofobstructed or unobstructed view between each player with respect toevery other player.

Finally, at step 225, an overall ranking for each of the one or morestorylines is determined by associating the one or more weightingfactors with the base rank. In some embodiments, the base rank ismultiplied by each of the one or more weighting factors to calculate aweighted sum representative of the overall ranking. In variousembodiments, the weighting factors have accentuating or diminishingeffect on the overall ranking of the one or more storylines. In variousembodiments, the overall rank is determined at a predetermined frequencyin the game match.

It should be appreciated that while executing the method 200, the module130 continuously stores and/or updates data related to the basicpremise, base criterion, position coordinates and distances of eachplayer with respect to every other player, base rank, one or moreweighting factors and the overall ranking, for each of the one or morestorylines, in the database system 150.

Camera Intelligence Engine or Module 135

The camera intelligence module 135 implements a plurality ofinstructions or programmatic code to control a virtual camera so as toenable adaptive or intelligent navigation, positioning and viewingorientation of the virtual camera. The camera intelligence module 135may utilize analytical capabilities to process various data sets, suchas including but not limited to: data sets that are specific to players,data sets that are applicable to the game, storyline data, storylineranking data, scenes of interest conveyed by one or more spectators,rules governing preferred camera shots, and rules governing preferreduse of specific types of cameras.

In accordance with an aspect of the present specification, the cameraintelligence module 135 considers a spectator as a pseudo-player in thegame match, assigns the pseudo-player's camera identity or entity to aninvisible game object (that is, the virtual camera) which is thereaftermanipulated like any other game object through a plurality ofinstructions or programmatic code for navigation, positioning andorientation.

In some embodiments, the module 135 is programmed to use data sets thatare generally applicable to a game to control the virtual camera. Thedata sets used are indicative of scenes of interest to spectators. Thedata sets that are generally applicable to the game may include generalinformation about the storyline rankings, game map, location of playerswithin the game map, heat maps, kill locations, action for a givenlevel, player performance, among others. In embodiments, real time datafrom the gameplay is used by the module 135 to determine where battleshave occurred and correspondingly control the virtual camera.

In embodiments, historical game data is used to determine the data setsapplicable to the game. For example, locations that are most probablefor kills or other types of actions, are designated as kill locations,or action locations, respectively. Similarly, historical gameplay datais used by the module 135 to obtain data sets pertaining to each player,each team of players, and each game level. The data pertaining theplayers and the teams may be used by the module 135 to analyze theplayer or team that is most likely to win, the individual gameparameters of the players such as their kill-to-death ratios, playersthat are most active, among other parameters. The historical gameplaydata may be obtained from previous matches, gameplay events, played bythe current players, teams, or other players. Module 135 utilizes thedata to determine the location of cameras where battles tend to occur,and enable spectators to view multiple locations in a multi-windowviewing environment. Module 135 also uses this data to determine cameraplacement and movement.

In embodiments, certain rules of cinematography are provided to theengine or module 135, which are combined with the available data sets onthe game, the game map, the game levels, the players, the teams, thestoryline ranking, and any other information that may be derived fromthe gameplay; to control the virtual camera(s). Some of the basic rulesof cinematography, used in accordance with the embodiments of thepresent specification, may include the 180-degree rule, the rule ofthirds, head room, balance, and leading lines. The rules ofcinematography are used to improve image compositions, so that theyappear more cinematic and therefore interesting to the spectators.

A ranking system, similar to that used by the module 130, may be used bythe module 135, to analyze and rank locations on a game map within agameplay session, the game levels, the players, and the teams, based onthe quantity, intensity, and quality of actions within each parameter.In embodiments, the rank data, in combination with game map, location ofplayers within the game map, heat maps, kill locations, action for agiven level, player performance, and rules of cinematography, informsmodule 135 to select a type of camera, a position of camera, anorientation of the camera, among other camera parameters, to control thevirtual camera(s).

Additionally, the camera intelligence module 135 controls the virtualcamera in response to dynamic rankings of storylines determined inreal-time during a game match or offline after completion of the gamematch. In embodiments, the virtual camera generates video output of atleast one scene of interest in a game match for broadcasting over thenetwork 115 for viewing or spectating at the spectator devices 145.

In embodiments, the module 135 is programmed to receive historicalgameplay data, player information, real-time match data, including gamemap, location of players within the game map, heat maps, kill locations,action for a given level, and player performance, among other types ofdata. These data are combined with specific rules of cinematography, andcontrol the position and movement of the virtual camera in response tothe data.

FIG. 3A is an exemplary block diagram illustrating the different typesof data 322 that may be combined with specific rules of cinematography324, by the module 135, to control the position and movement of thevirtual camera. Different types of data may include at least one or moreof storyline ranking data 326, historical gameplay data 328, player data330, and real time match data 332. Other types of game-related data (notshown) may also be included, for example game map, kill locations, andaction for a given game level. The data is obtained from database 150.Data received by module 135 is then analyzed to determine thepositioning and movement of the virtual camera, so as to capture thedifferent scenes of interest.

In one embodiment, the module 135 is programmed to receive overallrankings of storylines from the storyline ranking module 130 or accessthe overall rankings from the database system 150, combine them withspecific rules of cinematography, and in response automatically navigatethe virtual camera to capture and broadcast the scenes of interestinvolving storylines with the highest ranking and with applicable rulesof cinematography, at any given point in time.

In some exemplary embodiments, the virtual camera settings arecontrolled with respect to the 180 degree rule. Accordingly, the camerais positioned to capture an interaction between at least two players byorienting the camera on a 180 degree line that keeps the two players onthe same position on the screen. If the two players are kept on the sameposition, say a first player is always kept on the left side of acinematic frame and the second player is always kept on the right side,the spectator is least likely to be confused.

In some embodiments, the rule of thirds is incorporated into theanalyzed data sets. Accordingly, a scene, a subject, or an object thatis captured by the virtual camera is likely to be more interesting if itis put slightly to the side of an image, instead of the center of theimage.

In some embodiments, the rule pertaining to headroom is incorporated.Accordingly, a certain amount of space is left between top of thesubject's head and the top of a frame. The space allows for room tocapture movement of the subject in the frame without cramping the frameor cutting-off the image of the subject.

In some embodiments, images are balanced by positioning the virtualcamera so that weight of the subject is visually balanced with otherobjects in the frame.

In some embodiments, leading lines from surrounding visuals are used incombination with the rule of thirds, to align the subject along thoselines. In other words, the subject is aligned with lines that cometowards the subject, while keeping the subject slightly on the side of aframe. The leading lines provide a subtle, natural, means for directingthe viewer's attention towards the subject or place of importance withina scene.

In embodiments, this navigation of the virtual camera is constrained,bound or governed by a plurality of pre-stored (in the database system150) yet customizable camera intelligence rules, logic or imperatives.In accordance with aspects of the embodiment where storyline rankingdata 326 is combined with cinematography rule 324, of the presentspecification, the plurality of camera intelligence rules or logic isconfigured to avoid situations where the virtual camera is toofrequently alternating between storylines that have oscillatingrankings. Therefore, the plurality of camera intelligence rules or logicare aimed at intelligently navigating the camera while setting certainlimitations on how far and frequently the camera can change scenes ofinterest.

In some embodiments, the camera navigation limitations are set withreference to the following exemplary parameters. A first parameterrelates to a travel distance of the camera as the module 135 evaluateswhether it should move to a new storyline (both in the horizontal andvertical directions). For example, in some embodiments, the camera isallowed to move from one scene of interest to another if the traveldistance for switching the scene of interest can be traversed within apredefined time range of 0.25 to 1 second. In an embodiment, the camerais allowed to move from one scene of interest to another if the traveldistance for switching the scene of interest can be traversed in 0.5seconds or less. In some embodiments, the camera is allowed to switchfrom first to second scene of interest by traveling a distance thatrequires a traveling time of greater than 1 second if a rankingdifference between the storylines involved with first and second scenesof interest is a spectrum of values lying between a lower end and ahigher end point value. In some embodiments, the lower end point valueis a first sliding scale ranging from 0.9 to 2 (with incremental valuesof 0.1). In an embodiment, the lower end point value is preset at 1point by default. In some embodiments, the higher end point value is asecond sliding scale ranging from 2 to 5 (with incremental values of0.1). In an embodiment, the higher end point value is preset at 3 pointsby default. Thus, in some embodiments, the camera is allowed to switchif the ranking difference between the first and second storylines rangesfrom 1 to 3 points or is otherwise confined to a predefined range ofless than a predefined value and not allowed to switch if the rankingdifference exceeds the predefined value. However, as mentioned earlier,the lower end of this range may vary in accordance with the firstsliding scale while the upper end of this range may vary in accordancewith the second sliding scale. It should be appreciated that lowervalues within the first sliding scale results in the camera switchingmore frequently between storylines. On the other hand, higher valueswithin the first sliding scale results in the camera being more “sticky”and preferring to remain focused with a scene of interest. Accordingly,the virtual camera is programmed to switch at a speed or rate that isdependent upon a first sliding scale, wherein the first sliding scale isindicative of a ranking difference between storylines included in therespective scenes of interest. In some embodiments, a value for thelower end of the spectrum automatically resets towards higher values ofthe first sliding scale after the virtual camera changes focus orswitches from the first to the second scene of interest, therebyinsuring the virtual camera does not switch scenes of interest toorapidly. Therefore, after the virtual camera switches in accordance witha first value of the first sliding scale, that first value is reset to asecond value that will cause the virtual camera to switch at a slowerrate than the first value.

A second parameter relates to how much the camera can rotate, tiltand/or pan. This parameter may result from a combination of one or moreof storyline data 326, gameplay data 328, player data 330, and matchdata 332. For example, in some embodiments, the camera is allowed torotate at a predetermined angular speed and acceleration. Accordingly,the virtual camera is programmed to rotate, tilt and/or pan at a scaleor speed that is constrained to a predetermined set of threshold values,thereby insuring the virtual camera does not present an excessivelyjarring view. For example, the virtual camera may be constrained torotate, tilt or pan less than 45 degrees, 90 degrees, 135 degrees, 180degrees, 225 degrees, 270 degrees, 315 degrees, 360 degrees, or someincrement therein.

A third parameter relates to a predetermined (yet customizable) rankingthreshold. For example, a second storyline ranking must exceed a firststoryline ranking by at least ‘x’ number of points for the camera to beswitched from the first to the second scene of interest involving therespective storyline ranks. That is, a new storyline must be ranked ‘x’number of points better than the existing storyline for the module 135to switch the camera between their respective scenes of interest. Invarious embodiments, ‘x’ is at least 1 number of points, although one ofordinary skill in the art would appreciate that the precise units usedmay vary depending on the scale being used.

A fourth parameter, applicable to all types of data including storylinedata 326, gameplay data 328, player data 330, and match data 332,relates to establishing a predefined boundary or ‘sandbox’ beyond whichthe virtual camera is not permitted to be moved or relocated. In oneembodiment, module 135 defines a boundary, defined in terms ofthree-dimensional coordinates of a virtual map, around the coordinatelocation of the virtual camera. If, as a result of selecting a new sceneof interest to broadcast, module 135 determines a virtual camera'sposition should be redefined to a new coordinate location that isoutside the boundary, the virtual camera will be positioned at acoordinate point on the boundary that is closest to the new coordinatelocation but not external to that boundary. Accordingly, upondetermining a new scene of interest and therefore a new position for thevirtual camera, module 135 compares the coordinates of the new positionagainst the coordinates of the predefined boundary and determines if thecoordinates of the new position are outside the coordinates of thepredefined boundary. If the coordinates of the new position are outsidethe coordinates of the predefined boundary, the module 135 determinescoordinates on the predefined boundary that are closest to, orrepresentative of, the coordinates of the new position. If thecoordinates of the new position are inside the coordinates of thepredefined boundary, the module 135 moves the virtual camera to thecoordinates of the new position.

Before describing the fifth parameter, it should first be appreciatedthat, during the above described transitions from one virtual cameraposition to another virtual camera position, the virtual camera remainson, thereby continuously displaying the surrounding visual and auditoryelements of the video game as it moves from the first virtual cameraposition, angle, tilt, field of view or focus to the second virtualcamera position, angle, tilt, field of view or focus. However, there aresituations where the second position is so far from the first positionor situations where getting to the second position from the firstposition requires passing through such a contorted path thatcontinuously displaying the surrounding visual and auditory elements ofthe video game as it moves from the first virtual camera position to thesecond virtual camera position would take too long, require moving toofast, and/or would require moving in a jarring manner.

In such situations, a fifth parameter, which may be implemented in placeof the fourth parameter, establishes a predefined boundary or ‘sandbox’beyond which the virtual camera would “teleport” from a first currentposition within the boundary to a second future position outside theboundary. The view of the virtual camera first momentarily fades toblack (fadeout) upon leaving the first position and then fades to thenew view (fade-in) when at the second position. Accordingly, module 135may implement the teleport function when the module 135 determines thedistance or pathway between a first position and a second position istoo great, or too contorted, such that the speed the camera would haveto adopt to get to the new viewpoint in a standard camera transitiontime would create a video sequence too jarring and/or disorienting forviewers, possibly causing motion sickness in viewers. In such a case,the teleport function fades the viewer's view to black (fade-out),instantly moves the camera to the new viewpoint, and then fades theviewer's view back in from black (fade-in), thereby not continuouslydisplaying the surrounding visual and auditory elements of the videogame as it moves from the first virtual camera position, angle, tilt,field of view or focus to the second virtual camera position, angle,tilt, field of view or focus. In some embodiments, the module 135teleports the virtual camera when 1) the module 135 determines there isobstructive geometry or other visual hazards between a first positionand a second position or the pathway is otherwise too contorted, 2)module 135 determines to jump-cut between multiple cameras responsiblefor covering different subset-volumes of a playing field, or 3) themodule 135 determines to reset a poorly-performing camera.

It should be appreciated that the parameters are only exemplary and inno way exhaustive and therefore may be expanded or relaxed by theadministrator as per need. Further, the parameters are derived fromdifferent types of data including and not limited to storyline rankingdata 326, gameplay data 328, player data 330, and match data 332. Thus,the plurality of camera intelligence rules or logic implements theaforementioned exemplary parameters to determine ‘when’ the module 135should navigate/move the camera between scene of interest in a gamematch.

FIG. 3B is a computer-implemented method of controlling navigation,positioning and orientation of a virtual camera configured to capture aplurality of scenes of interest in a multiplayer video game forbroadcasting to at least one spectator device, in accordance with someembodiments of the present specification. In embodiments, the method isimplemented by the camera intelligence module 135. Referring now toFIGS. 1, 3A, and 3B, at step 350, the module 135 accesses from thedatabase system 150, a combination including one or more of overallranking data 326 for the plurality of storylines within the plurality ofscenes of interest, historical gameplay data 328, player data 330, andreal time match data 332, in a game match of the multiplayer video game.

At step 352, the module 135 either receives or accesses from thedatabase system 150, preferred rules of cinematography to be selectivelyfollowed while pursuing the plurality of storylines in the game match ofthe multiplayer video game. In some embodiments, the cinematographyrules are defined with reference to the 180 degree rule, the rule ofthirds, head room, balance, leading lines, among other rules.

At step 354, it is determined how the virtual camera should benavigated, positioned and/or oriented to capture a scene of interestbased on the combination of one or more of overall ranking data 326 forthe plurality of storylines, historical gameplay data 328, player data330, and real time match data 332, in a game match of the multiplayervideo game. At step 356, the virtual camera is navigated, positionedand/or oriented to capture video data of a scene of interest determinedat step 354, subject to a plurality of camera navigation rules, andsubject to the plurality of cinematography rules. In some embodiments,the plurality of camera navigation rules comprise at least one of aspeed of movement, acceleration of movement, an angular speed ofrotation and an angular acceleration of rotation of the virtual camera.In embodiments, the captured video data is broadcasted to one or morespectator devices 145 over the network 115.

In some embodiments, the virtual camera is controlled based on thestoryline ranking data 326 alone. FIG. 3C is a computer-implementedmethod of controlling navigation, positioning and orientation of avirtual camera configured to capture a plurality of scenes of interestin a multiplayer video game for broadcasting to at least one spectatordevice, in accordance with some embodiments of the presentspecification. In embodiments, the method is implemented by the cameraintelligence module 135. Referring now to FIGS. 1 and 3C, at step 305,the module 135 either receives from the module 130 or accesses from thedatabase system 150, overall ranking for the plurality of storylineswith the scenes of interest in a game match of the multiplayer videogame, or a combination of multiple factors including and not limited tothe storyline ranking data, gameplay data, player data, and match data.

At step 310, the module 135 either receives from the module 130 oraccesses from the database system 150, preferred rules of cinematographyto be selectively followed while pursuing the plurality of scenes ofinterest in the game match of the multiplayer video game. In someembodiments, the cinematography rules are defined with reference to the180 degree rule, the rule of thirds, head room, balance, leading lines,among other rules.

At step 315, it is determined if the virtual camera should be navigated,positioned and/or oriented to capture a scene of interest determined tohave a storyline with highest overall ranking amongst the plurality ofscenes of interest, subject to a plurality of limiting factors. In someembodiments, the plurality of camera navigation rules are predefinedwith reference to: a first parameter that limits a distance which thevirtual camera must travel to capture the storyline having the highestoverall ranking, a second parameter that limits at least one ofrotation, tilt and pan required for the virtual camera to capture thehighest overall ranking storyline and a third parameter that requiresthe highest overall ranking of the storyline to exceed an overallranking of an immediately preceding storyline by a predeterminedthreshold number of points.

At step 320, the virtual camera is navigated, positioned and/or orientedto capture video data of a scene of interest determined to have ahighest overall ranking amongst the plurality of storylines, subject toa plurality of camera navigation rules, and subject to the plurality ofcinematography rules. In some embodiments, the plurality of cameranavigation rules comprise at least one of a speed of movement,acceleration of movement, an angular speed of rotation and an angularacceleration of rotation of the virtual camera. In embodiments, thecaptured video data is broadcasted to one or more spectator devices 145over the network 115.

In accordance with aspects of the present specification, the pluralityof camera intelligence rules or logic also determines ‘how’ the module135 should navigate/move the camera between different scenes of interestin a game match. In some embodiments, rather than a traditionaloverhead, third-person, or first-person view of the storylines, themodule 135 enables navigation, positioning and viewing orientation ofthe virtual camera such that to the spectators it appears as if thevirtual camera is being operated on a drone or by a live/humancameraman. The module 135 achieves this effect by enabling the virtualcamera to navigate as if the camera is trying to move, position andorient itself to get an ideal shot of a storyline; however the camerahas programmatically imposed limitations that mimic real-world likeconditions or constraints in how it can navigate, thereby preventing itfrom being able to always get into position to record an ideal shot(similar to a real drone or cameraman trying to capture the storyline).In some embodiments, an ideal shot corresponds to moving, positioningand orienting the camera such that two players (from opposing teams) inthe first person shooter (FPS) game session are directly in view alongan imaginary center vertical line of the game display area/screen. Insome embodiments, an ideal shot corresponds to moving, positioning andorienting the camera for focusing on a center point of an imaginary linedrawn between the two players. In some embodiments, an ideal viewingposition and orientation of the camera is one that further includes asmany other players as possible.

In embodiments, the module 135 acquires positions of the two players,defined in terms of three dimensional coordinates in a virtual map, aswell as that of a point midway, also referred to as a center point, onan imaginary ray joining the positions of the two players. In someembodiments, the module 135 is programmed to cause the virtual camera toadopt a position close to the nearest player, with reference to acurrent position of the virtual camera at any given point in time,within the scene of interest associated with the two players. The module135 is further programmed to cause the virtual camera to offset from thenearest player's position in a direction away from the other player andthe center point, so that all three dimensional coordinates related tointeractions occurring in the scene of interest, are dimensionallylocated on a single side of the virtual camera. This ensures that allcoordinates or points, relevant to the scene of interest, are in frame.From that location, the virtual camera is allowed to rotate to pointtowards the center point.

For example, assuming two players are positioned at points A and B,defined by coordinates (X1, Y1, Z1) and (X2, Y2, Z2), respectively, inthe virtual game map and further assuming a virtual camera is alreadypositioned at a coordinate that is closer to player B (X2, Y2, Z2) thanplayer A (X1, Y1, Z1), then the module 135 causes the virtual camera tomove to, or be assigned to, a three dimensional coordinate such that 1)the virtual camera is closer to player B than player A, 2) both playersA and B are located on one side (right, left, below, above) of thevirtual camera and 3) the virtual camera is offset from the position ofplayer B by a predefined orientation and/or distance.

In embodiments, at least the following factors are considered whendetermining the orientation and distance of an offset of the virtualcamera from the nearest player's position: a) the offset must be by apredefined distance of units that may vary based on a game mode and b)the offset position of the virtual camera will not cause a visible gameobject to be positioned between the virtual camera and one or moreplayers, thereby avoiding an obstruction or blocking of the virtualcamera from obtaining a shot from the offset position. In embodiments,the system determines if one or more visible game objects is virtuallypositioned within the field of view of the virtual camera and if one ormore visible game objects block the virtual camera's ability to see thenearest player from the predefined distance ‘d’, the virtual camera isre-positioned to reduce the predefined distance of units to a minimumpossible distance (from the nearest player) required for an unobstructedshot.

For example, the module 135 is configured to cause the virtual camera tofollow a scene of interest associated with the two players, A and B,such that the virtual camera is at a distance of 196 units behind and 64units above the nearest player, and continues to follow as close as 128units behind and 0 units above the nearest player. It should beappreciated that these distances may vary according to at least thedifferent modes of viewing the game. For example, a longer-distancebattle-royale mode may require the virtual camera to be programmed tofollow the nearest player from a longer distance. While a sportingevent, such as boxing, may require a shorter distance mode in which thevirtual camera is programmed to follow the nearest player from a shorterdistance.

FIG. 3D is another computer-implemented method of controllingnavigation, positioning and orientation of a virtual camera configuredto capture a plurality of scenes of interest in a multiplayer video gamefor broadcasting to at least one spectator device, in accordance withsome embodiments of the present specification. In embodiments, themethod is implemented by a combination of modules, such as modules 130and 135 on server 105. Referring now to FIGS. 1, 3A, and 3D, at step334, information is received and analyzed to identify one or morestorylines. As previously described, the term “storyline” is defined asan in-game, virtual interaction between a first player and at least oneother second player or actor in a multiplayer video game. A storylinetherefore includes outcomes, occurrences, episodes or events, whichoccur in a game match and that are of value, significance, appeal,curiosity or interest to a spectator and, therefore, impact theviewership, engagement, learning and/or entertainment value of a videogame. At step 336, one or more criteria are defined for controlling atleast one of the navigation, positioning, or orientation of the virtualcamera. Data is considered for the determination, such as including butnot limited to historical gameplay data, player information, real-timematch data, including game map, location of players within the game map,heat maps, kill locations, action for a given level, and playerperformance, among other types of data. The module 135 accesses from thedatabase system 150, a combination including one or more of overallranking data 326 for the plurality of storylines within the plurality ofscenes of interest, historical gameplay data 328, player data 330, andreal time match data 332, in a game match of the multiplayer video game.At step 338, these data are combined with a plurality of cameranavigation rules and subject to specific rules of cinematography, tocontrol the position and movement of the virtual camera. In someembodiments, the plurality of camera navigation rules comprise at leastone of a speed of movement, acceleration of movement, an angular speedof rotation and an angular acceleration of rotation of the virtualcamera. The module 135 either receives or accesses from the databasesystem 150, preferred rules of cinematography to be selectively followedwhile pursuing the plurality of storylines in the game match of themultiplayer video game. In some embodiments, the cinematography rulesare defined with reference to the 180 degree rule, the rule of thirds,head room, balance, leading lines, among other rules. At step 340, theone of the plurality of storylines is broadcast from the server to atleast one the computing devices 145 over the network 115.

Using a Live Camera-Person

In some embodiments, the module 135 is configured to use a motioncapture (mocap) movement reference system to manually cause the virtualcamera to follow a scene of interest. In some embodiments, a module 160is integrated within one or more game servers 105. The module 160 isconfigured to integrate mocap controls over the virtual camera. In someembodiments, module 160 is in communication with module 135. In someembodiments, module 160 is a part of module 135. An exemplary method ofincorporating the mocap system to control the virtual camera isdescribed in the flow chart of FIG. 3E. Referring to FIG. 3E, at step342, movement of a human camera person is monitored within a mocapreference system. In embodiments, a motion capture system is integratedwith a human who is virtually placed within the game. Motion sensors areattached to a suit that is worn by the live camera-person, who in turn,is placed to move within the game in a mocap studio. The livecamera-person traverses the game levels by using mocap and using thecaptured data to control the in-game cameraman. At step 344, movement ofthe virtual camera is controlled to capture storylines, based on themovement of the human camera person within the mocap reference system.Presence of the virtual camera controlled by a live camera-personenables traversing the game in a manner similar to a camera-personcapturing images in real-life situations. Mocap technology is used tocapture the movements of the camera-person in the mocap studio. Themocap data is used to control the virtual avatar of the livecamera-person, where the virtual avatar is a virtual camera-person. Atstep 346, the storylines captured by using the mocap reference systemare broadcast from the server to at least one the computing devices 145over the network 115.

In the mocap system, the live camera-person wears multiple illuminatingmarkers on a suit worn by the live camera-person. The live camera-personmoves around a mocap stage to move inside the game. One or more digitalcameras record the movement of the live camera-person while the markerson the suit are illuminated at one or more positions, which areindicative of the movement of the live camera-person. A digital orvirtual in-game representation of the camera-person is generatedthereafter by analyzing the coordinates of the markers and mapping themonto the corresponding virtual avatar of the in-game camera-person. Inembodiments, the live camera-person carries a camera device. The cameradevice may be any device that enables the camera-person to control thevirtual camera in the game. Examples of the camera device include, andare not limited to a gamepad and a monitor, a gamepad and an AR/VRheadset, or a device that incorporates motion sensors that allowrecording of movements such as tilting, of the camera. Therefore, thein-game camera movement mimics the actual movement of the camera deviceas controlled by the live camera-person, thereby providing the feelingand benefits of having an actual camera-person in the gameplay. Inembodiments, during gameplay, the players of the game in the virtualgame world do not see the virtual camera-person. The presence of thecamera-person is simply to control the speed and movement of the virtualcamera. In some embodiments, the camera device is configured to enablethe live camera-person to control the cinematic operations of thevirtual camera, such as and not limited to, moving the camera-device,panning-in or out, and fixing the camera view.

In some embodiments, the cinematic control operations performed on thecamera device by the live camera-person override the mocap inputs tocontrol the virtual camera. Additionally, in some embodiments, the mocapsystem's cameras may not capture the camera-person's movements, for amoment or a few. For such glitches, when the mocap system's cameras misscapturing the camera-person's movements, additional motion sensors areplaced on the camera-person's suit, which provide a back-up method ofcapturing the movements.

Virtual players in the game often traverse disproportionately longvirtual distances than what a live-cameraperson can physically traverse.Therefore, in embodiments, a scale factor of the camera-person isadjusted to allow for faster traversal within the game.

Further, the camera-person's movements are limited to within theboundaries of the virtual landscape of a game. In some embodiments, thecamera-person's in-game movement has the same limits as any otherin-game player. The camera-person's movement in the virtual world issubject to the same rules as any other player. The rules may include,for example, inability to walk through solid objects in the game, samejumping/flying abilities as other players, same speed/accelerationlimits, among other limitations. In some embodiments, the livecamera-person observes the gameplay on a screen or a headset or someother type of display device, and corrects movements to avoid virtualobjects.

In some embodiments, the camera-person is provided with additionaltraversal and movement abilities. The additional traversal abilities mayinclude, among other abilities, the ability to: teleport from one pointto another, walk through solid objects, and fly or accelerate/move athigher rates. In some embodiments, a combination of mocap and one ormore other input, are used to provide and/or enhance traversal toelevate the camera vertically, while the camera-person's mocap inputcontrols movement in the horizontal plane. In another example, thecamera-person uses the controller to select a location in the map thathe would teleport to. In yet another example, the camera-person can usea control to alter self-movement speed in game. In one more example, aphysical controller is used in conjunction with the camera-person'smotion, such as when the camera-person uses the controller to movetowards a battle, and then transitions to using mocap to control thecamera once the camera-person is near the battle.

Manually controlling the virtual camera, in addition to AI-basedcomputer control, provides several benefits. The factors that areconsidered when determining the orientation and distance of an offset ofthe virtual camera from the nearest player's position can be decidedinstinctively by the live camera-person who may reposition the virtualcamera so as to optimize the offset based on a game mode. The humancamera person positions the virtual camera such that a visible gameobject is not positioned between the virtual camera and one or moreplayers, thereby avoiding an obstruction or blocking of the virtualcamera from obtaining a shot from the offset position. The camera-personmay also control the position, distance, angle, axis, orientation, andother image parameters, based on the camera-persons view within a game.

In some embodiments, the module 135 enables to move, position, and/ororient the camera to achieve an ideal shot less than 100% of the time.For example, an ideal shot, as defined above, occurs between 1% and 99%of the time, or any numerical increment therein, while, the remainder oftime the virtual camera is programmed to provide a shot that is subjectto one or more artificially applied constraints to achieve the effect ofa real drone or cameraman. Module 135 is programmed to apply suchartificially applied constraints in the form of one or more rules orlogic that embody one or more constraining or limiting navigationparameters such as, but not limited to:

-   -   Speed of camera movement—in some embodiments, a maximum speed        and acceleration of the camera is a function of a maximum speed        and acceleration of the players in the first person shooter        (FPS) game session. For example, in some cases the maximum speed        and acceleration of the camera is same as that of the players        whereas in other cases the maximum speed and acceleration of the        camera are more or less than that of the players. Such        variation, of the maximum speed and acceleration of the camera        vis-à-vis the maximum speed and acceleration of the players,        enables creation of an effect that when a player is moving        slowly, the camera is able to stay right behind the action or        storyline, but when the player suddenly takes off, the camera        appears to lag slightly behind the action and eventually catches        up when the player slows down.    -   Angular speed of camera rotation—in some embodiments, an angular        speed or acceleration of rotation of the camera is constrained        to predetermined (yet customizable) degrees per second. This        limitation again enables creation of the effect that sometimes        the camera is unable to capture a perfect or ideal shot, but        eventually catches up to the action.

In some embodiments, the plurality of rules or logic implemented by themodule 135 enable movement, positioning and/or orientation of the cameraby considering a plurality of game factors such as, but not limited to,what weapon a player (in the first person shooter (FPS) game session),being followed by the camera, is holding. Thus, in embodiments, thecamera is automatically navigated to stay close (to the player) if theplayer is holding a short range melee weapon while pulling back if theplayer is using a machine gun.

In some embodiments, the plurality of camera intelligence rules or logicimplemented by the module 135 ensure fail safes in case the camera is nolonger capturing the most interesting or highest ranking storyline butit is too undesirable to pan the camera to a new storyline (owing to theplurality of navigational limiting parameters, for example). In someembodiments, therefore, the video output of the camera is allowed tojust fade to black and the camera is moved, repositioned or reoriented.In some embodiments, the plurality of camera intelligence rules or logicimplemented by the module 135 performs collision detection such that thecamera avoids or otherwise navigates around solid structures and objectsin the level.

Spectator Engagement Module 140

In embodiments, each of the one or more spectator devices 145 implementsthe spectator engagement module 140 that operates as a game viewingapplication. The module 140 implements a plurality of instructions orprogrammatic code to provide a spectator with at least one interfacebetween the spectator and the video data broadcast, of a game match,received from the camera intelligence module 135. The engagement module140 generates at least one interface to receive the video databroadcasted by the camera intelligence module 135, render the video dataassociated with the game match, and enable the spectator to view aplurality of viewing options. Thus, the module 140 also captures andprocesses spectator inputs and interactions with respect to theplurality of viewing options and provides updates to the cameraintelligence module 135 over the network 115 for subsequentimplementation.

In various embodiments, the engagement module 140 provides a spectatorwith the following exemplary viewing options:

-   -   A GUI (Graphical User Interface) displaying a dashboard        comprising information of the top ‘n’ ranking storylines in a        game match, such as the first person shooter (FPS) game session        involving Team Alpha and Team Beta. It should be appreciated        that the ranking data is periodically generated by the storyline        ranking module 130 and stored/updated in the database system        150. The engagement module 140 accesses the most recently        updated ranking data from the database system 150 and displays        on the dashboard. In some embodiments, the module 140 enables        the spectator to choose any one of the ‘n’ ranking storylines        that he would like to view. The spectator's choice of the        storyline is communicated to the camera intelligence module 135        that, as a result, broadcasts the scene of interest        corresponding to the chosen storyline to the spectator's device.    -   A GUI to enable a spectator to filter the scenes of interest.        For example, in some embodiments, the spectator can choose to        view video data pertaining to storylines involving only x, y and        z players or storylines related to only a particular team.    -   A GUI to enable a spectator to request kill-cam replays during        or after completion of a game match. As known to persons of        ordinary skill in the art, in first person shooter (FPS) games,        killcam refers to a virtual camera that reveals the way that a        player was killed, displaying an instant replay of the player's        own death through another player's eyes.    -   A GUI that provides a spectator with a plurality of parameters        to affect or control a positioning and/or viewing orientation of        the virtual camera that records various scenes of interest. In        some embodiments, the plurality of parameters may include tilt        and pan options of the virtual camera.    -   A GUI that enables a spectator to choose a picture-in-picture        (PIP) mode of viewing. In PIP mode, a first game video is        displayed on the full GUI screen at the same time as a second        game video is displayed in a smaller inset window. Sound is        usually from the game video displayed on the full GUI screen. In        some embodiments, the first and second game videos may be two        different scenes of interest or two different views of the same        scene of interest. For example, the second game video (rendered        in the small inset window) could be a view from a sniper's scope        while the first game video (rendered in the full GUI screen)        could be the standard storyline view of the sniper. In another        example, the first and second game videos could be the two        highest ranking storylines. In some embodiments, the engagement        module 140 enables the spectator to toggle between the first and        second game videos.

In alternate embodiments, each of the one or more spectator devices 145implements the game module 120′ configurable to operate as a gameviewing application for the spectator. In accordance with alternateembodiments, the game module 120′ can be operated in either aplayer-centric or a spectator-centric mode. When operated in theplayer-centric mode, the game module 120′ allows all functionalitiesrelevant for a player to interact and play the game match. However, whenoperated in the spectator-centric mode, the game module 120′ allows allfunctionalities relevant for a spectator to view the game match. Thus,in spectator-centric mode, the game module 120′ generates at least oneinterface to receive the video data broadcasted by the cameraintelligence module 135, render the video data associated with the gamematch, enable the spectator to view the plurality of viewing options,captures and processes spectator inputs and interactions with respect tothe plurality of viewing options and provides updates to the cameraintelligence module 135 over the network 115 for subsequentimplementation.

In further alternate embodiments, each of the one or more spectatordevices 145 implements a client software application (such as, forexample, the Open Broadcaster Software) that receives the video data,broadcasted by the camera intelligence module 135, via a third partyvideo game streaming service such as, for example, Twitch or Mixer.

Embodiments of the present specification enable viewers to gain anenhanced viewing experience by enabling them to control the viewscaptured by the virtual camera. As a result, the viewers or spectatorsmay provide input to change camera angles, play slow motion replays,scrub through the broadcast, and follow different players in a game,among other options, while viewing their scenes of interest. In someembodiments, the received and rendered video data pertains to a defaultscene of interest determined, by the camera intelligence module 135,based on factors including one or more of storyline ranking data,historical gameplay data, player data, and real time match data.Conventionally, the video data is rendered on at least one GUI forviewing by at least one spectator. In some embodiments of the presentspecification, the video is rendered by a cloud-based renderingfacility.

The present specification utilizes cloud rendering and enables cloudrenderers to be used to operate as a game viewing application for thespectator. Cloud rendering provides the advantage of virtually infinitecomputing power to create and render videos and game images withhigh-speed. Similar to module 120′, the cloud renderers may be operatedin either a player-centric or a spectator-centric mode. When operated inthe player-centric mode, the cloud renderers allow all functionalitiesrelevant for a player to interact and play the game match. However, whenoperated in the spectator-centric mode, the cloud renderers allow allfunctionalities relevant for a spectator to view the game match. Thus,in spectator-centric mode, the cloud renderers generate at least oneinterface to receive the video data broadcasted by the cameraintelligence module 135, render the video data associated with the gamematch, enable the spectator to view the plurality of viewing options,captures and processes spectator inputs and interactions with respect tothe plurality of viewing options and provides updates to the cameraintelligence module 135 over the network 115 for subsequentimplementation. In some embodiments, game logic servers are attachedwith the cloud renderers. In some other embodiments, the game logic isembedded in the cloud servers and the cloud servers are used to createenhanced views of game play. Therefore, recreation of the game play isoffloaded from the end user device, including devices 110 and 145, tothe cloud servers. The end user (player and/or spectator) still has a UIthat allows control over viewing features, but all the commands get sentto the cloud server for implementation. This way, the end user device isstill mainly just a video playback device.

In some embodiments, the cloud renderers of the present specificationare used by e-sports streamers, broadcasters, or by game AI, such asincluding module 135, to generate enhanced replays and views, forviewing by the players and spectators. Data stored in the database, andincluding storyline ranking data 326, historical gameplay data 328,player data 330, and real time match data 332, among other types ofdata, is analyzed by module 135. The analyzed data is used by one ormore of e-sports streamers, broadcasters, and by game AI, to render datausing cloud renderers. In the AI scenario, compelling replays and livebroadcasts are created by using cloud-based rendering to stream videoscaptured by live-camerapersons.

FIG. 4 is a computer-implemented method 400 of enabling at least onespectator to view video data associated with one or more storylines in agame match of a multiplayer video game, in accordance with someembodiments of the present specification. In embodiments, the method 400is implemented by the storyline engagement module 140 on at least onespectator device 145 corresponding to the at least one spectator. Insome embodiments, the method 400 is implemented at a cloud renderer forat least one spectator device 145 corresponding to the at least onespectator. Referring now to FIGS. 1 and 4, at step 405, the module 140generates at least one GUI to receive video data pertaining to the oneor more scenes of interest, broadcasted by the camera intelligencemodule 135. At step 410, the video data is rendered on the at least oneGUI for viewing by the at least one spectator. It should be appreciatedthat in some embodiments, the received and rendered video data pertainsto a default scene of interest determined, by the camera intelligencemodule 135, associated with a highest overall storyline ranking in thegame match (subject to a plurality of rules). In some embodiments, thevideo is rendered by a cloud-based rendering facility.

At step 415, upon request by the at least one spectator (such as byclicking an icon on the at least one GUI generated in step 405), themodule 140 generates at least one GUI to display a plurality of optionsfor the at least one spectator to choose from in order to customize thevideo data being rendered.

If the at least one spectator chooses a first option then, at step 420,the module 140 accesses the most recently updated overall ranking datafrom the database system 150 and displays information about the top ‘n’overall ranking storylines on at least one GUI. At step 425, the atleast one spectator chooses any one of the ‘n’ ranking storylines. Atstep 430, the at least one spectator's choice of the storyline iscommunicated to the camera intelligence module 135 that, as a result,broadcasts video data (scene of interest) related to the chosenstoryline to the at least one spectator device.

If the at least one spectator chooses a second option then, at step 435,the module 140 displays identification credentials (such as, forexample, names) of a plurality of players and/or teams participating inthe game match on at least one GUI. At step 440, the at least onespectator chooses at least one of the plurality of players and/or teams.At step 445, the at least one spectator's choice is communicated to thecamera intelligence module 135 that, as a result, broadcasts video datapertaining to the scene of interest of the chosen at least one playerand/or team to the at least one spectator device. In some embodiments,cloud-based rendering is used by module 135 to broadcast the videos.

If the at least one spectator chooses a third option then, at step 450,the module 140 generates at least one GUI and renders therein kill-camreplays of one or more scenes of interest during or after completion ofthe game match.

If the at least one spectator chooses a fourth option then, at step 455,the module 150 generates at least one GUI to enable the at least onespectator to choose at least one of a customized positioning and/orviewing orientation of the virtual camera that records various scenes ofinterest. At step 460, the at least one spectator's choice(s) iscommunicated to the camera intelligence module 135 that, as a result,broadcasts video data (to the at least one spectator device) of variousscenes of interest in accordance with the chosen positioning and/orviewing orientation of the virtual camera.

If the at least one spectator chooses a fifth option then, at step 465,the module 150 generates a picture-in-picture (PIP) mode of viewingvideo data related to at least two scenes of interest. In PIP mode, afirst video data is displayed on the full GUI screen at the same time asa second video data is displayed in a smaller inset window. In someembodiments, the engagement module 140 enables the at least onespectator to toggle between the first and second video data.

The above examples are merely illustrative of the many applications ofthe system and method of present specification. Although only a fewembodiments of the present specification have been described herein, itshould be understood that the present specification might be embodied inmany other specific forms without departing from the spirit or scope ofthe specification. Therefore, the present examples and embodiments areto be considered as illustrative and not restrictive, and thespecification may be modified within the scope of the appended claims.

1. A computer-implemented method of controlling at least one of anavigation, positioning or orientation of a virtual camera configured tocapture a plurality of storylines in a multiplayer video game forbroadcasting to at least one computing device, said method comprising:analyzing, in at least one server remote from the at least one computingdevice, data to identify the plurality of storylines; defining, in theat least one server, at least one criterion for controlling the at leastone of the navigation, positioning or orientation of the virtual camera;programmatically moving, in the at least one server, the virtual camerato capture one of the plurality of storylines based on the at least onecriterion; and broadcasting, from the at least one server to the atleast one computing device, the one of the plurality of storylinesdetermined based on the at least one criterion.
 2. Thecomputer-implemented method of claim 1, wherein the programmaticallymoving the virtual camera is based on one or more cinematography rules.3. The computer-implemented method of claim 1, wherein the at least onecriterion comprises at least one of a storyline ranking data, gameplaydata, player data, or match data and wherein each of the storylineranking data, the gameplay data, the player data, and the match data isdetermined from the multiplayer video game.
 4. The computer implementedmethod of claim 3, wherein controlling the at least one of thenavigation, positioning or orientation of the virtual camera uses the atleast one criterion to determine the storyline ranking data.
 5. Thecomputer implemented method of claim 3, wherein the at least onecriterion comprises combining a base rank from a base criteria and aweighting factor.
 6. The computer implemented method of claim 5, whereinthe base criteria comprises at least one of a distance between twoplayers in the multiplayer video game, locations of interest in a gamemap of the multiplayer video game, or virtual items of interest tospectators of the multiplayer video game.
 7. The computer implementedmethod of claim 5, wherein the weighting factor is based on at least oneof a relationship between two players, a relative orientation of the twoplayers, or a field of view of the two players.
 8. The computerimplemented method of claim 1, wherein controlling the at least one ofthe navigation, positioning or orientation of the virtual camera isbased on storyline ranking data that is generated in real time duringthe multiplayer video game.
 9. The computer implemented method of claim1, wherein controlling the at least one of the navigation, positioningor orientation of the virtual camera is based on storyline ranking datathat is stored from previously played sessions of the multiplayer videogame.
 10. The computer-implemented method of claim 1, wherein analyzingdata to identify the plurality of storylines comprises identifying atleast one event in the multiplayer video game that is of interest to atleast one spectator of the multiplayer video game.
 11. Thecomputer-implemented method of claim 1, wherein the programmaticallymoving the virtual camera is based on at least one of data specific toplayers of the multiplayer video game, data applicable to themultiplayer video game, storyline data, storyline ranking data, scenesof interest conveyed by one or more spectators of the multiplayer videogame, input from a motion capture movement reference system, cameranavigation rules, or cinematography rules.
 12. The computer implementedmethod of claim 11, wherein the camera navigation rules comprise atleast one of a speed of movement of the virtual camera, an accelerationof movement of the virtual camera, an angular speed of rotation of thevirtual camera, or an angular acceleration of rotation of the virtualcamera.
 13. The computer implemented method of claim 12, whereinprogrammatically moving the virtual camera based on input from themotion capture movement reference system comprises: monitoring movementof a human camera person within the motion capture movement referencesystem, wherein a virtual equivalent of the human camera person ispositioned inside the multiplayer video game environment; andprogrammatically moving the virtual camera to capture one of theplurality of storylines based on the movement of the human cameraperson.
 14. The computer implemented method of claim 13, whereinprogrammatically moving the virtual camera comprises enabling the humancamera person to control at least one operation of the virtual cameraand wherein the at least one operation comprises at least one of movingthe camera, panning-in or out, or modifying the camera view.
 15. Asystem for controlling at least one of a navigation, positioning ororientation of a virtual camera configured to capture a plurality ofstorylines in a multiplayer video game executing in a plurality ofgaming devices and configured to broadcast the multiplayer video game toa plurality of spectator devices, said system comprising: at least oneserver configured to host a game session of the multiplayer video gameand to broadcast the hosted game session to each of the plurality ofspectator devices through a network; a plurality of gaming modulesstored on the plurality of gaming devices remote from the at least oneserver and configured to enable a plurality of human players to play inthe game session of the multiplayer video game; a plurality of spectatormodules stored on the plurality of spectator devices remote from the atleast one server and configured to enable a plurality of humanspectators to view the broadcast of the game session, wherein at least aportion of the plurality of spectator modules are executing on at leasta portion of the plurality of gaming devices and wherein at least aportion of the plurality of gaming modules are executing on at least aportion of the plurality of spectator devices; at least one processor,in the at least one server, wherein the at least one processor isconfigured to execute a plurality of programmatic instructions to:define a function to identify the plurality of storylines; define atleast one criterion for controlling the at least one of the navigation,positioning or orientation of the virtual camera; programmaticallymoving the virtual camera to capture one of the plurality of storylinesbased on the at least one criterion and at least one cinematographyrule; and broadcasting the captured one of the plurality of storylinesto at least a portion of the plurality of gaming modules and/or at leasta portion of the spectator modules.
 16. The system of claim 15, whereinthe at least one criterion comprises at least one of a storyline rankingdata, gameplay data, player data, or match data and wherein each of thestoryline ranking data, the gameplay data, the player data, and thematch data is determined from the multiplayer video game.
 17. The systemof claim 16, wherein controlling the at least one of the navigation,positioning or orientation of the virtual camera uses the at least onecriterion to determine the storyline ranking data.
 18. The system ofclaim 15, wherein the at least one criterion comprises combining a baserank from a base criteria and a weighting factor.
 19. The system ofclaim 18, wherein the base criteria comprises at least one of a distancebetween two players in the multiplayer video game, locations of interestin a game map of the multiplayer video game, or virtual items ofinterest to spectators of the multiplayer video game.
 20. The system ofclaim 18, wherein the weighting factor is based on at least one of arelationship between two players, a relative orientation of the twoplayers, or a field of view of the two players.
 21. The system of claim15, wherein the at least one processor is configured to execute aplurality of programmatic instructions to control the at least one ofthe navigation, positioning or orientation of the virtual camera basedon storyline ranking data that is generated in real time during themultiplayer video game.
 22. The system of claim 15, wherein the at leastone processor is configured to execute a plurality of programmaticinstructions to control the at least one of the navigation, positioningor orientation of the virtual camera based on storyline ranking datathat is stored from previously played sessions of the multiplayer videogame.
 23. The system of claim 15, wherein the at least one processor isconfigured to execute a plurality of programmatic instructions toidentify at least one event in the multiplayer video game that is ofinterest to at least one spectator of the multiplayer video game. 24.The system of claim 15, wherein the at least one processor is configuredto execute a plurality of programmatic instructions to programmaticallymove the virtual camera based on at least one of data specific toplayers of the multiplayer video game, data applicable to themultiplayer video game, storyline data, storyline ranking data, scenesof interest conveyed by one or more spectators of the multiplayer videogame, input from a motion capture movement reference system, or cameranavigation rules.
 25. The system of claim 24, wherein the cameranavigation rules comprise at least one of a speed of movement of thevirtual camera, an acceleration of movement of the virtual camera, anangular speed of rotation of the virtual camera, or an angularacceleration of rotation of the virtual camera.
 26. The system of claim24, wherein the at least one processor is configured to execute aplurality of programmatic instructions to programmatically move thevirtual camera based on input from the motion capture movement referencesystem by: monitoring movement of a human camera person within themotion capture movement reference system, wherein a virtual equivalentof the human camera person is positioned inside the multiplayer videogame environment; and programmatically moving the virtual camera tocapture one of the plurality of storylines based on the movement of thehuman camera person.
 27. The system of claim 26, wherein the at leastone processor is configured to execute a plurality of programmaticinstructions to programmatically move the virtual camera by enabling thehuman camera person to control at least one operation of the virtualcamera and wherein the at least one operation comprises at least one ofmoving the camera, panning-in or out, or modifying the camera view. 28.(canceled)
 29. (canceled)
 30. (canceled)
 31. (canceled)
 32. (canceled)